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Preface 
The Artificial Intelligence Laboratory proposes to continue Its work on 
a group of closely interconnected projects, all bearing on questions 
about how to make computers able to use more sophisticated kinds of 
knowledge to solve difficult problems. This proposal explains what we 
expect to come of this work, and why It seems to us the most profitable 
direction for research at this time* 

The cor* of this proposal 1$ about well-defined specific tasks such as 
extending the computer's ability to understand Information presented as 
vl sual scenes—or In natural , human language, Al though these specific 
goals are Important enough In themselves, we see their pursuit also as 
tightly bound to the development of a general theory of the computations 
needed to produce Intelligent processes. Obviously, a certain amount of 
theory Is needed to achieve progress in this and we maintain that the 
steps toward a deep theory In this domain must Include thorough analysis 
of very specific phenomena. Our confidence In this strategy is based 
both on past successes and on our current theory of knowledge structure. 
These bases are discussed both below and In the appendices* 



To give a clearer Idea of this position, wr contrast our strategy with a 
number of Questions typical of an earlier phase of thinking ahout 
Artificial Intelligence (and which are still often posed by outsiders): 



You seem to be making "performance 11 programs for certain particular 
jobs. Why do you concentrate on "specialist" programs like 
VISION and the BLOCKS WORLD, that deal with such narrowly 
restricted kinds of objects? 

Why don't you do more work on learning? Aren't you building too 
much of the solutions Into your programs. Instead of petting 
them to adapt themselves to new situations? 

Why don't you pursue more "general" problem solving methods? Are 
you using the right kinds of computers? Shouldn't you model 
the brain more closely? 

Our answers to such Issues ar^ all tied closely together. Of course we 

want to develop programs with very broad powers. But finding how to do 

this Involves the usual paradoxical strategy of Science: the keys to 
"generality" often lie In understanding thoroughly certain Issues that 
arc best studied In special situations In which the issues are 
particularly clear. We believe that for us the most central such issue 
Is this: how can we exploit diverse kinds of knowledge In the same 
process? 



The art of computer programming has developed along lines 

very narrow lr this regard. Each kind of "subrout Ine", in 

traditional programming, expects to get Information In one 

specific format, "data type", or structure. Two processes 

operating at different "levels" then cannot communicate 

directly. The traditional solution Is to organize all 

complicated programs Into a series of stages or "passes" lr 

which t^e data-types change sharply and Irrevocably. 

Unfortunately, as we and others have found, this Is 

Incompatible with many Imnortant intelligence-like 
processes. 



Our proposed solutions are still evolving, but they all seem to turn 
around new methods of prograrrmlnE and new ways to represent knowledge 
about programming. The field of Artificial Intelligence has rarie 
enormous prorress in the past few years toward brcomlng a scientific 
subject, Amon£ its frost powerfully productive par^dlfms are: 

Learning Structural Descriptions 
Heterarchical Programming 

Knowledge about Procedures 
Procedural Embedding 

In our proposals for the past two years, we explained why we see these 

as important and how we plan to develop them. We append thr central 

portions to this proposal, as appendices. Readers who have followed Al 

closely should have no difficulty with the language of those 

expositions/ but readers unfamiliar with the jargon of this field would 

do better to begin with our book-length report A. 1 . MEMO 252, a general 

Introduction to the role of our work In relation to other sciences 

concerned with thinking and Intelligence* The central part of this 

proposal will spell out the state of the particular projects to which 
those general ideas are applied in our laboratory. 

Por some years, we have been developing these new methods largely In the 
context of two "micro-worlds' 1 , the VISION SYSTEM and the BLOCKS WORLD. 
Within these models we now can work on sophisticated technicucs for 
learning, as well as on the new styles of programming. While both of 
these older worlds are very special ized In a number of ways, a third 



domain Is now beginning to crystallize; It Is a more gereral, corrmon- 
sense domain of discourse In which one can discuss many everyday 
concepts we are sure must be Involved in "thoughtful" act i v I ty—such 
matters as time, space/ purpose, planning, simple economics, need for 
knowledge, etc. 

OOALS and APPLICATIONS 

The next few sections are about our main goals, both for long-range 
research and for particular appl icatlon areas. The general technical 
position of our 1070 and 1971 proposals still represents the direction 
of our approach. However, although those proposals are relatively 
explicit about the hrgh-level problems motivating our research, they do 
not give a very clear picture of the actual projects, or of their 
practical conseauences. In this proposal we shall concentrate on giving 
a more concrete view of our Immediate goals. The next four sections are 
each directed to an "area" of application. It will be obvious that the 
concepts and methods used In these areas are closely related. Our 
intentions about the applications vary, naturally. In some cases we 
have major efforts toward completing effective operational prototypes. 
In the rest, we expect to produce demonstration prototypes, or only to 

develop some theory, clarify problems, and attempt to direct the 
attention of others to problems which we think need Immediate attention. 
Some projects art limited because we don't yet know how to proceed 
faster, others are limited simply hy the size of the project staff, or 



by no- longer adeouat e hardware* 

AREA I: ROBOTICS, V1SI0I", AUTOMATION 

AUTOMATION and PRODUCTI VITY: 

Even tn Its current early stare of development, Al Is ready for 
application in rrary practical areas such as Industrial as^nr^bly, 
fabrication. Inspection, mining, medic ine, under see and space 
exploration, and arriculture* Although we are rot directly active 
In these areas, the Al Lah makes efforts to Inform Individuals and 
agencies who might be so involved. The United States has not 
addressed the problem of general productivity with the imagiretior 
and energy appropriate and necessary to meet future needs. The 
Laboratory has probably had a large effect ir drav'irg attention to 
this situation and the past year has sren a substantial growth of 
concern with this area, ir governmrnt and Industry, 

In conjunction with development of the mini-robot, v/r plan to work 

toward e demonstration of Its applicability to automation. The tarret 

application Is not yet settled; the front runner Is automated assembly. 

Inspection, and testing of very small computer processors, built of 

microelectronic components. This choice of application might seem a 

little "inbred 11 ; the main factor is simply that the microelectronic 

industry is the only one really concerned today with very small 

assemblies. We are still open to suggestions about other applications. 



RPP-OTICS: 

We would llVe to see much rore sophisticated computer controlled 
effectors become available for practical application es well as for 
research. There has been much too little develonment In the field 
of mechanical manipulators. Even though there are perhaps £0 
competing "industrial robots" In production today, they are all 
astonishingly uniform in their primitive articulation. Hone have 
but the most rudimentary feedback facilities. Although It would be 
a serious diversion to try to make our Laboratory into a center for 
renerel drvelopment of reliable mechanical hardware, we and the 
other ARPA projects are playing a critical role in drafting 
prototypes and stimulating national activity in that area. 



In particular, D, Silver Is now debugging a force-f eerthack systpm that 
usns strain measurements In the manipulator's wrist. This appears to be 
extremely effective for practical matters, as a compromise hetvreen 
elaborate touch sensors (that are hard to relate to larper-scale forces) 
and motor-load feedback systems (which In principle Inform about local 
forces but are impractical Ir practice because of the very poor 
signal/noise ratio one has after subtracting out rravity and Inertia! 
terms for the whole moving mass). 

COMPUTER VISION: 

Our long-range goa I is to discover how to make machines able to 
look out at the world and "see". This plays such a large role in 
our previous work that we will not review It at this point, except 
to note that this goal involves major developments in arras often 
called "perception" and "pattern recognition". We maintain that 
good performance In non-tr I vial vi slon problems reaul res systems 
that really understand a lot about what they are looking at, And 
the kind of fundamental research on knowledge that we are doing can 
not be side-stepped* 

The MIT VISION SYSTEM Is, at present, still an experimental prototype 

developed to explore new Ideas both about machine vision and new styles 

of programming. It Is the most powerful system available within its 

narrow domain of analysing monocular, polyhedral scenes. We arc 

extending Its capabilities to deal with more natural objects- Up to 

now, this system could deal only with polyhedral objects having uniform 

plane surfaces, such as blocks, wedges, pyramids and the I ike. But 

(1) We are now working on processing and description of textured 

surfaces. 

(2) More global object-descriptions are being studied, using a 

scheme of Hollerbach that starts with basic shapes and 
describes local devlat ions from It; we expect to be able to 
extend thesp to non-planar objects. 

(3) Thp new system wl 1 1 be able to deal with motion and use It for 



visual purposes In applications such as pouring liquids, 
(d) We ere beginning to combine* visual, tactile and force feedback, 
and plan to demonstrate a significant autocratic assembly 
application, using the new mini-robot hardware* 

Vie hope to show that the sophistication developed over the years in our 

heterarchlcal vision system will lead to a system able to deal with 

seeing real situations like that in a regular tool box. Although the 

problems In a realistic environment will be more complex, we expect man> 

principles to carry over from our present system. Among these 

pr Inc I pies: 

The best methods for "low level" scene analysts lean towarH 
relatively simple low level filters guided by larpe amounts of 
knowledge about the objects. 

Oreat power derives from the use of a firm theory of the semantics 
of boundaries to rapidly classify lines as shadows, cracks, concave 
or convex edges, etc* Better results come from using higher level 
knowledge than from attempting to push the use of local optical 
cues beyond meaningful limits. 

We know a good deal about building descriptions In terms of geometric 

and optical relations between objects, ways to hypothesize objects from 

partial presentations and ways to propose groupings and using the groups 

to aid analysis. It remains to be seen how smoothly this experience car 

be transferred from the old BLOCKS WORLD to the realistic scene world. 



MUM-ROBOTICS: 

We have a particular Interest In developing laboratory eaulpment 
for robotics research on a very small physical scale. We have two 
reasons for this. First, there are Important appl icatfons for a 
mechanical "mlcrotechnology" that does not now exist, yet there Is 
no serious technical limitation deterring it. These applications 
range from involving fabrication and assembly of physically small 
hut complicated systems to new applications In medicine/ 
agriculture, and space that are generally unrecognized at present. 
For details, see our proposal to ARPA about Microtechnology. 
Second, we feel that there Is now a sturdy backlog of good ideas 



for advanced automation that arp developlnp very slowly only 
because It is hard for people to set up research la bora tor f rs ir 
this field. This project Is an opportunity for our Laboratory to 
simplify and rrodernize its own equipment and, at the same time, 

produce an easily-copied system that we hope will have a 
substantial effect In speedlnf up prorress In other centers. 

We emphasize that the si2e scale Irvolvrd In our mini-robot project Is 
NOT 50 small as to require major engineering innovations. The devices 
will work within a space of a few Inches, with accuracy on the order of 
.001 Inch, which Is a modest precision In machine tool practice. We 
expect the system to be able to handle tasks on an order of magnitude 
smaller than docs current equipment, without creating very serious new 
design complications, 

AREA I I; Knowledge 

"The trouble with computers Is . . . I " 

Everyone has his own complaint, deriving from some collection of bad 

experiences. The computer is too literal; you have to tell It about 

every possible situation, and even then It will manage to find some 

misinterpretation. Another way to put it is to say that today's 

computers have no "corrmon sense". For example. In the BLOCKS WORLD, we 

have to write explicitly into the program something that says not to try 

to out two blocks In the same place. Less trivial: 

If- there is a statement that "block 1 is on block 2 n , and 
some action moves block 1, then that statement should be 
removed. 



To do this explicitly for all kinds of statements leads to serious 
problems/ because some such statements concern others. We need a more 
general method. Not too general, of course; If an action causes block 1 
to be painted red/ we don't want the action of moving it to make the 
machine think It will become green againl Solution: the machine should 
know that "geometric" aspects like "above"/ "parallel to"/ "to the left 
of" transform In certain ways, while "surface" properties like "freen", 
"rough"/ "sticky", transform In other viays. These er^ things that 
"every child knows". 

Even In situations that seem very simple to people/ behaving in a 

"sensible" fashion requires knowing a lot about many different kinds of 

things. In one way or another, every facet of our Laboratory is 

concerned with such issues, as are the other Al laborator les. 

Ordinarily/ In each particular problem area, one accumulates more and 

more "ad hoc" techniques that improve competence. Unfortunately, this 

kind of experience doesn't seem to lead to general Insights. 

Formulating the theoretical Issues Is critical if we are to make sense 

of the whole area and discover practical methods for handling real world 
problems. The issues can be formulated along a number of dimensions: 



BROAD vs. DFEP: 

Most workers seem to believe that common sense reasoning Is fairly 
"shallow" in the sense that If the process were represented as a 
logical deduction process the "proofs" would not be very long. 
Fven so, finding a proof with just 10 steps would pose a terrible 
search problem, because It Is clear that the basis for common sense 
reasoning must contain many thousands of Items. The problem, then. 
Is more one of finding a mechanism for determining "relevance" than 



finding ore for deduction. Such a mechanism would depend, 
presumably, on building a cl ass i f 1 catory structure for how 
different kinds of knowledge Interact. 

INDEPENDENCE: 

How does one &d<* new Information to the system? In one ideal, all 
information Is expressed in the form of compact "decl arat i vp" 
statements: "broken class Is sharp"; "powers of a grour element 
form cyclic subgroups"/ etc. In the "theorem-provl ng" arproach to 
reasoning, all the Informatlor Is so represented on the same level, 
as "axioms' 1 , and new Information Is added simply by adding another 
axiom. 

Thi s Ideal leads, unfortunatel y, to some serious difficulties. One 

really cannot use "facts 11 unless they are accompanied by Information 

about how to use them. Some facts serve to warn against using other 

facts for certain jobs. A person's most Important kind of Information, 

perhaps. Is about thinking Itself; how to break a problem into subgoals, 

deciding when certain kinds of analogies are appropriate, when certain 

kinds of plans are realistic, etc. We don't know enough, yet, about how 

to represent Information about such matters. Independent of particular 

application areas, and this makes problems for the theorem-provl ng 

approach. 



PROCEDURAL vs. DFCLARATIVE: 

These problems seem at first not oulte so difficult when one 
considers embedding knowledge in the form of procedures. A warning 
about a certain "fact" becoming undependable In some kind of 
situation can be embodied by programming an appropriate test at the 
right place In the problem-solving program. But this only raises 
other, equally hard problems. Embedded In a procedure, the meaning 
of an assertion can become deperdent on Its local context to such a 
decree that Inserting more knowledge beccmes very hard. In the 
declarative system this problem of local dependence Is not so 
acute, but It Is only an Illusion to think that It can be made to 
disappear effect I vel y. For even in the ax iomat ic systems, the 
meaning of a term depends on other assertions using that symbol, 
and the Interactions can become badly dispersed; one suddenly sees 
the local dependence as a lost advantage Instead of as a nuisance. 



An Intermediate kind of system--the "production 11 o' our colleagues 
at CMU— has many problems of its own; the effects of iten*s nrr 
influenced largely by their neighbors, they have some degree of 

Independence, but It Is hard to see how they can apply to one 
another in ways that would be useful for planning. 

This Is an area of I n tense intel lectual act iv I ty today, wi th very 

diverse viewpoints. Our plan Is not to attempt yet to decide which 

approach Is best, for each has important elements, but to attempt to 

extend our microworlds In several different ways to find what are the 

Important problems and phenomena. 



NATURAL LANGUAGE: 

Work Is continuing on various extensions of SHRPLU, Winograd's 

language understanding system. The availability of this system 
over the ARPA network, In a well documented version at CMU, v/ill 

perm It faster progress In developing techniques for int roduclrg new 
concepts. Unfortunately, our own computer system Is too overloaded 

to make the facility available to many outsiders, and It will no 

doubt load the other systems rather heavily, as well. 

Work on language will continue to develop both theory and 
extensions of current capabilities* A variety of seminars arc 
directed toward a deeper understanding of the processes involved In 
language understanding, with one goal--that of defining the 
directions for a "next generation 1 ' language understanding program. 
A number of students are working on aspects of syntax and 
semantics, such as the problems of auant if ler scope, the add 1 1 Ion 
of a wider range of syntactic constructions to the previously 

developed grarrmar, the issues raised by simple sorts of language 
translation and the problems of generating complex syntactic 
structures from a semantic base. Drew Mcuermott (see below) Is 
writing a program which will make the sort of plausible inferences 
necessary for understanding language in context. This Is being 
f^one in conjunction with the development of the CONNIUER language 
as a formalism for representing and manipulating knowledge. His 
program follows a narrative of a simple series of events, trying to 
draw causal connections between them and making predictions about 
what It expects to happen. 

Several things are being done to make the earlier work (see last 

year's prorress report) more useful to other people. Some of them 

ere being done in conjunction with the Project MAC automatic 
progremmTng group and the A! project at Carneg te^Mel Ion. They 



involve providing easier ways to interface programs with new data 
areas, a user-engineered front end enabling people to run the 
programs and Interrogate them through the use of a simple command 
tree. Improved documentation and other descriptive material such as 
flow charts of the grammar. 

UNDERSTANDING NARRATIVE: 

In his recent thesis, Eurene Pharnlak proposes a technique for 
handling many aspects of common sense In connection with 
understanding narrative. A narrative Is a sequence of statements 
describing a sequence of events, understandable by a person, but 
which usually contains a near minimum of detail* A great deal of 
material must be filled in by the reader, using his own store of 
general knowledge, to convert a narrative to a step-like chain of 
statements that say everything explicitly, Charnlak sketches out a 
sequence of stages of analysis for each sentence that may result in 
filling In many such details. These mechanisms are supposed to 
help resol ve ambigui ties, determine unspec I f t ed references, propose 
motivations for actions and generally act as Information retrieval 
and plausible explanation devices. 

Charniak f s central mechanisms Involve sett ing up procedures cal led 

"demons' 1 . These are essential 1 y PLANNER antecedent statements that are 

set up by local contexts and then persist, actively "watching" for 

statements that might signify the occurrence of certain activities that 

particularly concern the demon. For example, when a mathematical 

subject Is mentioned, the system could set up a demon that monitors the 

subsequent text for ordinary words that happen to have special 

mathematical significance, so that meanings would be considered that 

would have a very low rate of occurrence In ordinary text. 



Last year's proposal mentioned plans for this system. It has changed 
and developed substantially and the thesis will be available soor as a 
report. There does not yet exist an operational system for exploring 
the advantages and limitations of this Idea and constructing one will 
depend on recruiting capable workers for that project. 



f! 



UNOFRSTAKPIf'fi NARRATIVE, 2: 

While Charnlak's work applies to a world that reculres a vrry wide 

knowledre base"It Is the world of things a first-grade child must 
know to understand his reading books, Drew McDprmott Is attempting 
a system that attacks the same general kind of prohlen In a less 
local way, by attacking a problem of narrov/rr scope but greater 

logical depth, Charnlak's system can be viewed as an experiment to 
see how far one can go In filling In narrative details by setting 
up predictions whenever possible to embody what one already knows 
or might reasonably expect about the situation. These expectations 
operate on a very wide range of subject matter but they have no 
general mechanl sms for deal Iftg wi th compl lea ted interact ions. 

McDermott's model operates in a much more restricted domain— an 
extension of Wlnograd's BLOCKS WORLD, which now contains an actor 
with his own motivations and knowledge. Again, the system has to 

tenerate a hypothetical scenario to be consistent with a narrative. 
*he system must deal with different kinds of causality, decide 
which kinds of explanations would be adeauate for an actor who has 
specific items of knowledge and generally have theories about what 
kinds of assertions are "plausible 11 under different belief 
conditions. In particular, the system must distinguish between 

actions that are plausible to It and those that are plausible to 
the actor who may not know that a certain object is behind another, 

GtC, 

INFORMATION RETRIEVAL: 

This field, which addresses a problem of recognized and ever- 
growing Importance, has been dominated up to now by marginally 
useful attempts to classify knowledge without understanding It. *n 
any particular application, such an "Information retrieval 11 system 

can be made to do a certain amount of useful screening but as the 

data base expands past the experimental prototype, one always finds 

a threshold that If set too low Inundates the user with too rruch 
hut If set higher misses too many relevant Items, Obviously, one 

can escape this only by Increasing the degree to which the system 

itself can deal with the meanings of the class If I catory concepts. 

As our work on language-understanding progresses, we can expect 

more and more areas of application for such techniques. Our new 

l, ml cro-v/or ids 11 of common-sense reasoning should begin to open up 

the area of Information retrieval to effective applications of 

Artificial Intelligence research. 

We do not have a committment to any specific project In this Information 

retrieval area. However, we are convinced that It Is approaching the 

time when such a study will be worth while and we plan to discuss It 

with others versed in bibliographic and library sciences. 



AREA III: PROGRAMMING 

Workers In Artificial Intelligence have played important roles In the 
development of many new kinds of programming languages. As far as our 
own purposes were concerned, the language situation In our Laboratory 
was. If anything, unusually stable over a decade; almost all Al work 
(except, notably, the Greenblatt Chess program) used LISP as Its haslc 
language, and LISP development Itself was generally conservative. 

However, during this period several sub-languages were developed within 

the specialist program projects; for example METEOR and CONVERT were 

completed and used in cases where LISP seemed Inadequate. These were 

early pattern directed systems related to COMIT and SNOBOL and, more 

recently, such Ideas and many others were put together In Hewitt's 

PLANNER, While the earlier steps In this direction were exploited only 

by their Inventors, PLANNER'S time was evidently ripe, for It was 

auickly adopted for use by Winston's Vision project, Winograd's Natural 

Language project and several others In our Laboratory. Thus we have 

seen the first major language change in a long time. Many other AI 
centers are already working with versions of MIfRO-PLANNER, en 

Implementation of a subset of Hewitt's proposed large system. Now under 

development, jointly with Project MAC, Is a more comprehensive system 

for PLANNER. In the meantime, experience with MICRO-PLANNER led to a 



reaction by some users who had dlfflcultiPS with debugging In situation 
where PLANNER'S unprecedented facilities for automatic search, backup, 
and revision of Its own data-structures could get out of hand and also 
In situations where programmers wanted their programs to have access to 
Information about just what happened within the autocratic searches. 
This led to the proposal of COHNIVER, by Sussman and others, a language 
In which one has many of PLANNER'S specification and automatic 
facilities but with more control over multiple functional environments, 
return to previous states and explicit control of backup situations, I" 
may take Quite some time to settle the batch of new practical and 
theoretical arguments about which assortment of structures and features 
should be given priority in the "general purpose" Al language of the 
near future; In the meantime one has little choice but to encourage 
experimentation In this area. We list below activities bearing on this 
subject: 



LANGUAGE DEVELOPMENT: PLANNER 

Jointly with Project MAC, a PLANNER development project is under 
way. There are Quite a few interesting problems of how to 
implement the new kinds of objects and Quantities. It Is not an 
ordinary systems programming problem. There are serious 
theoretical problems about the extent to which such programs can b- 
compiled, and little is known about what running speeds are 
possible in any case. 

LANGUAGE DEVELOPMENT; CONNIVER 

fonniver perm Its direct cross commun teat ion between different past 
states of a running program. Thus, one can make a suggestion and 
ask how It would have helped in a previous attempt to solve a 
problem! At first sight, the Implementation problems appear 
enormous but many students &rc thinking about this and we art 
optimistic that a system will be built that can efficiently run 
1 arger-than- M toy" problems- 



LANGUAGE DEVELOPMENT: LOGO 

The language LOGO, developed In our Education project, now has an 
incarnation within LISP, developed by I. Goldstein, This brings a 
useful tool into the ARPANET comnunlty of Al workers, because of 
the rapidly growing body of work in children's cognitive 
development that Is involved with the use of this language. 

LANGUAGE DEVELOPMENT: LISP 

In association with MATHLAB, our version of LISP, MACLISP, has been 
under continual development, primarily by Jon White and others, and 
there Is now a version accessible to the ARPA network. 

PROGRAM-UNOFRSTANDI NO PROGRAMS: 

Elsewhere in this proposal, wr mention several projects that ore 
connected with language development. Although rot directly 

concerned with new major languages, each has a specialist language 

of Its own and some of the ideas In them are sure to be demanded 

and implemented by others in one or more of the major exterior 

languages. Particularly promising In this regard are the projects 

that are developing programs which, understand other programs, 
notably the experiments of Goldstein, Sussman, McDermotc and 

Hewitt, The control structure of Winston's VISION SYSTEM, 

currently written In PLANNER, Is also likely to stimulate new 

styles of procedure description. 

THEORY OF PROGRAMMING: 

The Al LAB has played a key role In persuading the computer science 
community to consider more realistic problems; to shift their 
attention from syntactic form to semantic content. In programming 
languages this means a move from computer-linguistics to theory of 
control structures. In mathematical research this means shifting 
from Inflnltary logic and recursive function theory to theories of 
computational complexity, and theory of solvability of control for 
simple problems. Both of these are just as "abstract" and 
theoretical, but far more realistic and practical. 

Indeed, such results from recursion theory as "the unsol vabt li ty of 
the halting problem" can be deeply misleading. For an 
"Interesting" class of practical programs, knowledge of the 
prograrraner ' s Intent, and understanding of common control structures 
is sufficient to debug a non-halting program. Similarly, In the 
areas of "pattern-recognition" and perceptual sciences, we have 
helped to turn the emphasis from "invariants" to goal -relevant 
descriptions and, generally, from a wi shful -th I nk I ng search for the 
Gestalt to thr careful analysis of ways In which processes can pass 
from local features to global descriptions and back, In 
heterarchlcal control structures. 

While wp plan to continue working In these areas. It Is Impossible 
to predict which will develop next or In which way. While we stanc* 



by our judgements about priorities of importance in this sort of 
theoretical research, our Laboratory Is I r danger of becoming 
Ineffective in Implementing our opinions/ for budretary reasons. 
We cannot afford to recruit enough staff to maintain flrft-rete 
competence in the necessary areas. Vie plan to look for additional 
support In the theoretical area. 

AUTOMATIC PROGRAMMING: 

Many of our staff members are working on projects that hear on a 
common problem; how to create a computer program that satisfies a 
co Meet ion of goal -oriented cord I tions--that Is, a program that 
accomplishes a task which Is specified In terms of the result 
rather than in terms of the computational steps to be taken. This 
Is true "automatic programming" and the possibility of doing it 
resides essentially In the degree of our ability to represent 
within the computer appropriate kinds of knowledge about 
computation, programming, debugging, planning, etc. As the body of 
this proposal shows, our main current goal Is to develop this kind 
of knowledge and techniques for representing It and we expect that 
this body of work will lead, In the not too distant future, to real 
progress toward programming systems that can be told what kinds of 
programs are to be produced. 

AREA IV: Education and Prosthetics (Non-ARPA projects) 

EDUCATION: 

To give a rounded picture of the Laboratory's goals, we have to 
mention some work not supported under the ARPA contract, but 
mutual 1 y Interdependent with It. The largest such activity Is a 
program of research into the structure and development of human 
cognitive skills, with emphasis on developing ways to help people 
learn better how to learn. In this area, our Laboratory Is working 
on theories originating jointly In Artificial Intelligence and In 
the kind of developmental schemata proposed by Plaget and his 
colleagues. We feel that the discoveries we have made In this 
area have hren of major importance both In formulating new Ideas 

about design of superior educational paradigms, and in helping us 
formulate conjectures about how common sense knowledge may be 
structured for use in an artificial intelligence. 

PROSTHETICS and MOTOR CONTROL: 

A natural result of combining Ideas about artificial intelligence, 
robotics, and human problem-solving Is a new horizon of possible 
ways for men to control external devices. In instructing a robot 
to do a task, the ordinary industrial technique of recording the 
precise trajectory of a master-slave manipulation system will work 

only In the rigid assembly-line situation of absolute task 
repetition. An Intelligent helper, on the other hand, could do 
much more with an explanation or some meaningful gestures. We are 
planning some studies In which highly handicapped persons might 



control external systems, such as virtual keyboards or simple but 
versatile manipulators, by using limited motor channels augmented 
by sophrstlcated Intent ion- E uesslng software. One immediate soal 
may be to establish useful channels for Intelligent but isolated 
cerebral palsy victims to establish effective real world 
Interact Ions. 

Technically, this project resembles the ARPA speech program. In the way 
that limited objectives can have large values In the right situations. 
The scientific details may also turn out to be rather similar. We plan 
to approach a Health agency for support in this area, and to have this 
activity Involve people both In our Robotics and Education groups. 



PART Id f>nera1 Theory of Intel lirencr 

Why Ho we believe that we can achieve these reals? 

The complexity of the answer depends or the rferrre of achievement ore 
has in mind. The more immediate applications are easily seen to he 
"within the state of the art 11 set by recent v/ork ir our Laboratory and 
elsewhere. This Includes the construction of a working mini-robot, 
extending machine vision to some industrial situations, and so on. 
Other aspects of our goals cannot so easily be justified. Their 
achievement would depend on solving hard theoretical problems. Our 
confidence that this can be done rests on an elaborate theory of 
intelligence that reflects many years of work. In this section we 
review some of the issues In constructing this theory of Intelligence. 
It is not fully self-contained here and must be read In conjunction wl t 

our prorress reports, especially A.I. Meno 252 which is appended, and 
our previous proposals, 

- 
The form of our review is a brief, almost telegraphic, 

statement of the lines of approach to the problem of 

intelligence most corrmon arorg computer scientists. Its 

purpose Is to situate our own position in an Intellectual 

landscape that will be familiar to the reader. That is why 

vie will not review the many other. Quite different opinions 



held In other dlsc'pllnes. 

ADMINISTRATIVE POWER: 

The secret of Intelligence lies In a problem-sol vlrg strueturr that 
is Inherently highly efficient and selective, by virtue of some 
particularly good schemes for deduction, bookkeeping, r.oal-tree 
administration, redundancy-el Imlration, etc. 

LOPICAL UNIFORMITY: 

The secret of Intelligence lies in using a universal logical 
decision procedure. This should be able to handle all sorts of 
problems and not need special programming f or P3cr , new ^ I nd of 
problem. Of course, one must be able to suitably encode the 
different problems into It along with an adeouate set of 
ef f Iclency-enhanc ing heurlst Ics. 

C-OMMON SENSE: 

One can't expect much "general intel 1 Igence" unless the system 
knows the simplest kinds of things that every normal child does; if 
you move something It will no longer be where It was; two things 
can't be In the same place; If A precedes P and B precedes C then A 
must precede C; etc. Therefore we first should concentrate on a 
program with "common sense". This specialist pro/ram is essential 
for othrr developments. 



FPISTE w 0LOPtrAL POWER: 

A person seems Intelligent because he knov/s how to derl with f 
larre variety of problems. We therefore have to make collections 

of such knowledge anrf to do this we first fave to develop 
systematic schemata for acquiring, represent Ing and classifying #11 
the different kinds a knowledge that will he needed. 

LEARN I NO: 

It Is impractical to do all the work Implied by the previous two 
suggestions. It would be better to make a general learning prograrr 
that villi acquire both common sense and general knowledge by trial 
and error, reading books, etc. 

PROGRAMMING KNOWLEDGE: 

Perhaps the secret of the general problem solving ability of 
intelligence lies not in having enough adequate procedures in 
advance hut in being able to assemble, quickly, a problem solving 
program appropriate to the problem of the moment! This would still 
^e'an that one needs knowledge, but now it Isn't so general; what 
one needs is to know enough about progra^l ng (?to^ heuristic 
programming. In particular) so that one can write and debug P 
program that is good enough for the task. 

Before proceed! ng further, we should surrmarize our att i tude toward thesr 
viewpoints. There may or may not turn out to be other unsuspected 



general principles of great Importance. We ta^o the pnsltlon th*t *ll 
the above points are relevant but that one must Mso add: 



"CENERAL KNOWlEnpE": 

What wp see 3?»l nC ?2 llRe P? e<l Is a system's ability to solve 
diverse and difficult problems, m impressively short and effective 
ways. When a system solves a problem In a manner that does not use 
tedious search, we must say that It seems to know how to solve the 
problem. For various technical reasons, we cannot believe that 
there can exist "general 11 methods to do this on a wide variety of 
problems without a lot of stored knowledge, so a lot of 
Intel 1 igence, on the performance level/ must be in knowing how to 
solve problems eff Ic lent 1 y— and specifically. 

KNOWLEDGE ABOUT KNOWLEDGE: 

On the other hand, for other technical reasons we think that simply 
holding large stores of knowledge is inadequate, because 
performance will degraded—unless much of the knowledge Is 
structured to direct the use of the rest. Much of what one knows, 
then, will not appear at the "factual 1 ' level at all, but will 
concern when and how to use other parts of the Inforration store 
and, especial 1 y f when not to. 



Although a fixed store of such knowledge could be adequate for a vast 
variety of useful activity, some of It should be concerned wl th how to 
acquire more, so that Intellectual growth is possible. Mow much 
knowledge-structure Is needed to begin the "bootstrap" process? tte 
don't really know much about this* Our conviction Is that one must be 
v^ry cereful in theorizing about the development of intelligence in 
humans, not to overlook the amounts that may be absorbed from the 
environment In highly-prepared abstract form, in the course of acquiring 
language. Putting aside questions about how the linguistic processes 
themselves ere developed, we believe that even at the level of learning 
proper u*e of individual words, the child Is more or less forced to 



acquire thousands of Important corcrpts whose Importercr has h. rn 
deteri-Ired by mlllerra of forceful selection. 

Me have not mentioned many other oplnlors held by cor-puter scientists; 
for example, that perhaps the Important advances lip ir par«.llel 
processing, or in holistic access to content-addressed memory, etc. etc. 
We have noted only son>e of the views that May slrrlficant roles ir our 
owr models of the situation. 

Fven without attempting tn decide between these—or rather, dlscusslrg 
the roles that they each play— It should be clear that such a discussion 
presupposes a thorough understanding of the issues. Fxactly here lies 
the Importance of the relatively deep. If narrow, examinations of the 
"specialist" programs. Both the VISION SYSTEM and the PI OfTS WORLD have 
told us a great deal, not just about how "performance-level" krowledre 
pilrbt he structured but also about how problem solvers must be 
programmed. The new wave of programming methods — PLANNER, COHNI VER-- -and 
the Hierarchical approach In general, are all attempts to meet problems 
that arose In these studies; issues that never clearly crystallized Ir. 
the earlier studies on more "general" problem solving systems. 



LEARKIKf 

Morr ej*air there tiro a number of positions that each show or 1 y pert of 
the situation- n rp common view Is, we feel, really wronr; that Ihrrt 
?S a process called learnlnp which is aulte distinct from other mrrtal 
activities. Up list a nirmhpr of principles that rpy srrr obvious to 

some readers, and ppr^cps wronr to sorrp others. 

DrSCRIPTION: 

To record the Important corseqwrpcrs of an pxperlpnce, orp must 
extract and represent the essertial features. So learring is rol 
mere 1 y record I nr; It Involves shrewd abstract ion. Thtrp Is little 
use ir recording everything. 

urnFftSTANPI^G THE COAL: 

Up ought to know the kind of program structure we went to result, 
before we con expect to be able to design a program to learn that 
structure. If learning then consists of adding ax ions to a lorlc 
data base, the learner has to understand something about the 
"proof" procedure. If learnirg consists of makirg changes in 
programs, then the learner must know appropriate thirds about 
programming. 

irCRFHFMTALITY and CONTEXT-! MDEPf NDENCE: 

We want to he ahle to make small changes easily. Adding something 
new shouldn't distort everything learned brfnrp. So far as 
possible, the learning mechanism shouldn't have to toke into 
account everything pIsp already known; nor should ft have to know 
all about how everything Is orranized. On the surface, at least, 
this v/ould srprr to favor use of declarative statements, or 
product ! on-based programs. R ut we do rot really understand the 

p/tent to which these make It possible also to represent control 
structures in v/ays that arc also easily changed incrrmerta 1 1 y, and 

ve suspect that declarative structures will rot turn out to be very 

powerful in this regard, 

DFBUPCINC: 

Some learning, at least. Is rearrangement and debugfing, not just 
adding new perf ornarce-1 cvel krowlci'r** but reel ass if y leg It, 



rrst ructur Irr 1 t, modifying the procedures that prr^rrSR th*- w r*t f -> 
st rue turns ir which the ,,f actual* 1 krowerfjEn ! f emhnHdoH. 

LF ARM I MP TO LFARHi 

We cfrn't really expect, after all, to build a prnrram thet car .^c 

all these things from the start. £n th* learning profnw itsflf 

had better he self-applied so that It can be bcotst r^ppr^—bv * 
rood teacher. 

Our experimental and theoretical program must recognize that 

because we do rot yet have sufficiently Intelligent paradigm 

programs, we simply cannot yet fee) sure just what sorts of 

structures we will want our learning programs to learnl That is, 

although we cannot see any clear ard particular difficulty ahead ir- 

building learning programs, we do not yet knov: enough to "specify" 

them. At the risk of seeming to repeat. It can be put this way: 
we still do not have any prototype programs that exhibit 

satisfactory "common-sense" behavior usirg shallot* reasoning and 

large knowledge bases* Not having such a modf 1 for a target, we 

are not Quite ready to attack directly the problem of learning such 

a structure and still less ready for the problem of "learning to 

learn 11 It, 

The most promising system for learning at a symbol ic description level 
Is, at present, the one presented In Winston's thesis. That system is r 
specialist program; It works at building structural descriptions Ir the 
RLPCTS MnRLD hy "learning from examples". The basic strategy Ir this 
scheme is to compare a description of the current situation with certfcir 
"learned descriptions" that It has built up from earlier experiences. 
The "rose important" differences between the present reality and the 

stored paradigms ere computed by a procedure that embodies the machine's 
prejudices about what features of differences between situations are the 

rest Inportart. This general scheme raises a lot of specific problems 

■ 

for study: 



I'nderstandinj: d If fr re nets* 

The program of Winston's thesis builds ard modifies descrirtirrs by 
splectlnp: one "dominant" feature frrm many, \r etch cycle of 
compering two structural descri pt icrs. This Is dorr by a conmoi - 
sense ranking of some kinds of relations ovrr others. A rorc 
irtollirent way would be to understand how such features orr really 
related to the current goal; then the system could have "reisers" 
for its priorities* This would become Important when, ir new 

situations, 't would be able to rr-order these priorities In r 
rational way, by reasoning about its reasons. 

Procedural learning. 

With all that we have said about the irportance of lerrrire ard 

debug/ring procedures. It would seem natural to ask about extending 
or adapting the structural descr int ion-l earninp l>rorr#r to prnrrarr 
learning. At first glance, Z^prr seems a world of dif*erfrcn 
between describing stacks o* blocks and describirr computet ioral 
schemata. Uowrver, Winston's chanter on "Crovrirr" surgtsts that 
these mirht not he so far apart. We see a posslhle hrldre Ir the 
t ransformat lonal process that re corn Izrs repeated cha Ins of 
structural relations and represents then by a nor -repet I t i ve 
structure describing the typical ne I rhborhood of a "typical " 
rl cmrnt . 

?uch a "proup 11 structure resembles the Inr.pr loon of a prcprair. The 

abstraction process itself seems close to that one would use to eerie rat t- 

a closed subroutine to compress parts of an Iterative performance 

protocol (as proposed, for example, in Hewitt 1972). To meke It write 

an actual program one would need, in principle, orly to make it adt! to 

its representation of "typical element" Information about the Initial 
art* f ?nal elements as well. For example, the program now describes a 

"stack 11 by describing a "typical element" and noting that each typical 
element has another typical element above it. To copvert this to, say, 

a prorram for hvl Idler stacks, ore would wart to &t*<* an initialization 
Src t ior; 



"put a block or the teMe" 



and ar* exit condition: 



"stop If that Mock Is two frrt above the trhlr", 

The "Inner loop" ("put a block on that block") would br fprereteri by * 
procedure that understands how to make an element "typical", name 1 y, by 
the fiction "put a block on it"! 

PROGRAMMING EPISTEM010CY: 

If we do that/ have we made a larj*p step toward understanding 
enough about program-learning, or Is It a mietscule part of the 
job? To deal with such a questior, one would have to work with a 
classification of program-structures, and at least a tentative 
measure of the Importance of the different varieties. Clearly, one 
can do anything In principle/ v/lth the inl t ial ize-loon-exi t 

programming el erent, since the exit conril t ion al lows the express i or 
of conditionals. Equally clearly, the loop structure/ in practice* 

Is a very confining inexpressive structure for the kinds of 

procedures an intelligent system would seem to need* 

pROCRAMMrHG and PLANNIMR; 

The issue of how to represent abstractly, the protocol of an 
experience, t s cor pi icated by how representations irteract with 
various kinds o** goals. For example, one might ask for nrorosals 
about how a machine mirht have learned the processes that are 
preprogrammed into the problem-solving substructure of Winogred's 
BLOrKS WORLD. 

Corsider just the part of the system that removes all blocks or top of f 

block that the program wants to move. 

1. One might have a process In which the machine solves a particular 

case and then generalizes. If several blocks are removed, and the 
protocol of actions is analysed, it would not be hard to detect the 
repetition and represent it as a loop. 



2. In PLANNER code, however, there is no loop. One mijrht Instead 

recognize in the protocol the coal -subgoal -act ion relation of 
removing the supported block, and embed this In an antecedent 
theorem. Were, the generalization is easy, even from a single 
Instance; what is harder is to see how to notice the significance 
of the repetition; In other cases the one-example general izct ion 
will usually be wrong! 

3. In any case, the problem remains of generating a procedure 

appropriate to the goals. The CLEARTOP progrsro Is appronrlote only 
under certain conditions. If there are a great many blocks on the 
one we want to move, then CLEARTOP will involve a lot of work. Thr 
system should be able to learn that this may be a cordltion for 
backing up to another goal; It should perhaps he able to use 
knowledge about sweeping all the blocks off with a broom; It 
should perhaps know about lifting the lower block and dumping them 
off (and this may necessitate some cordon sense about the 
randomness of where they may land). 

h. We might really want to know how many blocks are on the one to be 

moved, so this klrd of observation might have to be prograrrmed In. 
What kind of knowledge is required to judge when counting Is 
appropriate? 

For some time, Cerald Sussman has been attempting to formulate the 

issues Involved In different ways to look at the problem. Recently, he 

has constructed a program which "learns" programs like the CLEARTOP 

procedure by running simpler programs on examples, detecting "bugs"-- 

incidents in which the program does something sllly-*and formulating a 

program change that makes It work on that example. It remains to be 

seen whether this approach to "learning through debugging" can be made 

powerful by providing it with enough diagnostic description and 

programming knowledge. It Is Interesting how issues arise In such a 

project that resemble problems In Quite diverse areas of computer 

science; issues about multiple processes, management of temporary 

storage, domains of protection (of the results of interacting subgoals), 

etc. 



PROGRAMS end INTENTIONS: 

A direct attack on thp problem of representing krowledre ehout 
Dro/ranvrlnc Is under way In the work of Ira Goldstein, who Is 
developing a system that undr rstands soirp structures of programs 
that produce graphical drawings. This project is interesting 
because i t combines grneral know/ 1 edf e about proprrms — loor 
structurrs, recursions, etc. with a semantic basis ir geometry— an 
area that we have always found particularly rrwardinr because of 
the deep mathematical techniques that are close to the surface of 

such activities. Goldstein's program attempts to relate the 
expressed Intention of the pror remrer"for example, a child viho has 

written a bugged LOGO program Intended to draw a figure of some 
specified kind—to the code he has written. It looks for clues 
about various kinds of familiar programming structures and should 
be able to debug the prorrerrr*er ' s code even when the actual code is 
hopelessly flawed. Such a program must handle a variety of 
different kinds of knowledge: 

about procedures 

about geometry 

about pictures and must explore how declarative descriptions 
of scenes relate to procedural drawing programs. 



